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(g) Virtual conferencing system. 



r) A remote conferencing system includes a 
host computer and a plurality of local compu- 
ters connected to the host computer by local 
area networks and/or wide area networks, for 
example. The host computer is adapted to gen- 
erate a common image for display by the local 
computers, users of the local computers being 
able to modify the common image. The host 
computer also controls an invitation system 
whereby a requester can invite participants to a 
conference by utilizing images of a hallway 
containing the doors of the rooms of potential 
invitees. Each room contains a local computer, 
a close-up camera and a survey camera. 
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This invention relates to remote conferencing 
systems. 

Systems are presently available wherein two per- 
sons can both see and speak with each other at a dis- 
tance. 

The article "Multimedia Desktop Conferencing 
System:MERMAID" by K Watabe et al, in NEC Re- 
search and Development, vol 32 No. 1 , January 1 991 , 
pages 158-167, describes a distributed multimedia 
desktop conferencing system wherein shared win- 
dows are shared by all the participants to a confer- 
ence and modifications made by a floor-holder are 
transmitted to all the participants at almost the same 
time. 

According to the present invention, there is pro- 
vided a remote conferencing system, including a plur- 
ality of local computers, characterized by a host com- 
puter adapted to generate a common image for dis- 
play by said local computers, and to allow users of the 
local computers to modify said common image. 

It will be appreciated employment of a host com- 
puter which generates a common image facilitates 
the exchange of information among the local comput- 
ers. 

An example will illustrate one form of the inven- 
tion. Two (or more) parties each operate their own lo- 
cal computers. The computers have associated video 
cameras, speaker-type telephones, and pointing de- 
vices (such as "mice"). When a conference is estab- 
lished, the local computers become connected to a 
host computer, via commercially available Local Area 
Networks (LANs) and Wide Area Networks (WANs). 

The parties send the information which they want 
displayed, such as drawings, to the host computer. 
The host computer generates a common video 
screen, which it distributes to the parties: they see 
the drawings at their own local computers. Each party 
can move a pointer on the display, and point to fea- 
tures on the drawings. The telephones and video 
cameras allow the parties to see and speak with each 
other. 

The host controls many of the events occurring 
during the conference, as well as those occurring 
both during initiation of the conference and after ter- 
mination of the proceedings. 

- For example, the host provides a system which 
allows a person to invite participants to the 
conference in a convenient manner, including 
some automated invitation features which will 
be described later. 

- As another example, the host provides some 
unique stenographic- and recording features. 

- As yet another example, the host can maintain 
the virtual conference room in existence after 
the conference terminates, so that the records 
of the proceedings remain available for per- 
sons who wish to examine them. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates equipment which enables a 
person to remotely attend a virtual conference. 
5 Figure 2 illustrates computer displays showing 

menu choices which allow a user to initiate a virtual 
conference. 

Figure 3 illustrate further menu choices. 
Figures 4, 5, and 6 illustrate a type of "telephone 
10 directory," in which the persons listed are not listed al- 
phabetically, but are listed by geographic location. 

Figure 7 illustrates a computer display showing a 
virtual hallway. Behind each door is a person's office. 
Each office contains the equipment shown in Figure 
is 1 . The person viewing the hallway can look into each 
office (if allowed to do so) via a connection made with 
the cameras shown in Figure 1. 

Figure 8 shows key-icons which can be used to 
gain entry to a virtual conference which is not open to 
20 the general public. 

Figure 9 shows one type of video screen which is 
generated by the host computer, and which is distrib- 
uted to all participants in the conference. 

Figure 10 shows a screen, of the type given in 
25 Figure 9, but further including a "Document to be 
Placed on Table," which was transmitted to the host 
by a participant, and which the participant will show 
to the other participants by placing it onto the "con- 
ference table." 

30 Figure11 shows the sequence ofevents by which 

the "Document . . ." of Figure 10 will become dis- 
played. 

Figures 12 and 14 illustrates display screens 
which can appear when one participant passes a note 
35 to another. 

Figure 1 3 illustrates one display screen which can 
appear when one participant "whispers" to another. 

Figures 1 5 to 22B provide flow charts illustrating 
the operation of the conferencing system. 
40 In the described system, the participants share a 

common virtual conference table. Each participant 
can 

(1) place a document onto the table electronical- 
ly. 

45 (2) write on the document, draw on it, and other- 

wise manipulate it, and 

(3) move a pointer to different positions on the 
document, to point to specific parts of it. 
All other participants see the the preceding three 
so events as they occur. 

The system further provides the following fea- 
tures: 

- The participants can privately whisper or pass 
notes to each other, without the knowledge of 

55 the others. 

- A person wishing to invite participants to a con- 
ference can "walk a hallway" shown on that 
person's computer display. Doors shown in the 
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hallway are virtual doors, through which the 
person can look into offices of invitees, via a 
video camera system. 

- The invitation process itself can be viewed as 5 
a conference between two parties, namely, the 
inviting person and the person (or office gen- 
erally) behind the door with which the inviting 
person is communicating at that time. 

Every office is equipped with the following equip- 10 
ment: 

a computer (termed a "local computer" herein), 
one or two video cameras, and 

a telephone having "speaker-phone" capabili- 
ty. One office is shown in Figure 1. 15 

One of the video cameras (a "survey camera") 
surveys the entire office from a point near the door, 
as though the camera were looking into the office. 
The second camera (a "close-up" camera) is located 
next to the computer, and provides a close-up view of 20 
the computer user. The second camera gives the 
"computer's view" of the user. 

One of the cameras can serve a second purpose: 
it can be used as an optical scanner, for capturing im- 
ages of documents and drawings. The computer is 25 
equipped with a frame grabber for converting the im- 
age seen by the camera into a bit-mapped file. Alter- 
nately, an optical scanner can be used for capturing 
these images. 

These individual systems are located at different 30 
geographic locations, and, when a virtual conference 
is to be held, become connected to a central, host, 
computer (or multiplicity of host computers) via the 
proper combination of Local Area Networks (LANs) 
and Wide Area Networks (WANs). 35 

A person requesting a conference informs the 
host computer by appropriate means. For example, 
the Requester can "click" a pointing device onto a 
"conference icon," such as that shown in Figure 2, on 
his display screen. In response, his local computer 40 
sends the proper signal to the host. Now, the host 
must be given several items of information, which 
can, for convenience, be divided into two groups. 

One group relates to the participants: 

~ Who are the participants? 45 

- Can others participate without invitations? 

- Can participants send substitutes? 

The second group relates to the conference 
room: 

- Where does it exist? That is, where does the so 
data structure reside from which the confer- 
ence room is constructed. The location must be 
known to a participant who wishes to find the 
conference room. 

~ What are the room attributes? 55 
- What is the room decor? What paintings are 

on the walls? 
~ What equ ipment is present in the room? For 

example, the host computer may provide 



the option for any participant to record the 
entire proceedings of a conference, or any 
selected part of the proceedings. This op- 
tion may be represented by an icon in the 
shape of a tape recorder, which is contained 
in the conference display screen. Similar 
options can be present in the form of icons 
in the shape of telephones, notepads, libra- 
ry books, tables, etc. 
The third relates to conference procedures: 

- What rules govern the conduct of the meeting? 

- Does the Requester have absolute control 
of the voice and message interaction 
among the participants? Or 

— Is the meeting a brainstorming free-for-all, 
where numerous people can speak at 
once? 

— What is the decor of the room? 

-What happens to the room when the confer- 
ence is adjourned? Are minutes of the confer- 
ence kept? 

These issues will be considered in detail. 

The Requester's local computer gathers the in- 
formation indicated by the menu shown in Figure 2. 

The Requester may have previously prepared a 
list of participants. If the list takes the form of a data 
file, he (or she) can send it to the host computer di- 
rectly. If not, he can convert the list into a data file and 
sent the data file to the host in several ways. 

One, he can type the list into his own local com- 
puter, thereby generating a data file. 

Two, he can show the physical, printed list to a 
digitizing device, which generates the data file. One 
such digitizing device is an optical scanner, which 
generates a bit-mapped image. The scanner sends 
the bit-mapped image to the Requester's local com- 
puter, which contains Optical Character Recognition 
(OCR) software. The OCR software translates the 
bit-mapped image into a data file written in ASCII 
code, which is sent to the host. 

Another digitizing device is the close-up video 
camera, if equipped with the proper lens. The local 
computer contains a frame-grabber, which captures a 
bit-mapped image of the list, and sends it to the OCR 
software as above. 

Once the host obtains the list, the host sends an 
invitation to each invitee, telling the date, time, place, 
subject, and any other relevant information about the 
meeting. One way to send the invitations is by elec- 
tronic mail, which is known in the art. A second way 
is for the host to leave an "invitation card," such as 
that shown in Figure 3, on the screen of each local 
computer. Such cards are later discussed. 

If the requester has no list, the host can give the 
option of picking names from a directory of names, 
akin to a "telephone directory." Another possibility is 
for the host to present the "telephone directory" in a 
more graphical format, such as the following. 
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The following invitation procedure can also serve 
as an actual conference, but held between the inviting 
person and the person invited. After the inviting per- 
son successfully establishes communication with the 
invitee, the inviting person, if desired, can order the 
host computer to provide an entire conference room, 
or selected equipment from the room, such as a re- 
corder, for the convenience of the two parties. Fur- 
ther, the two parties, during their conference, can 
"walk the halls," and invite other participants, thereby 
expanding the conference to include additional par- 
ticipants. 

Assume that the Requester wishes to invite fel- 
low employees to the conference. The host computer 
first displays a map of all locations of facilities of the 
company, such as in Figure 4. The Requester picks a 
state. The host displays the state, showing all compa- 
ny facilities, as in Figure 5. The Requester picks a fa- 
cility. The host shows the facility, in exploded form, 
as in Figure 6. 

Now the Requester can "walk the halls." The host 
shows an image of a hallway, as in Figure 7. Each 
door bears a name. The Requester scrolls along the 
hallway, until he reaches an invitee's door. The door 
can be open, closed, or ajar. The status of the door is 
under the control of the person occupying the office 
in question, via that person's local computer. 

If the office occupant does not wish to be inter- 
rupted by other people, the occupant instructs the 
conferencing system to close the door. Under such an 
instruction, the conferencing system shows a closed 
door to all Requesters who are "walking the hallway." 
In a similar way, the occupant controls whether the 
door is fully open or ajar. 

If the door is open, then the Requester sees the 
image which the survey camera sees of that person's 
office. That is, the Requester can look into the Invi- 
tee-Occupant's office. 

If the door is ajar, the Requester is given the op- 
tion of "peeking" into the office. That is, the Request- 
er is given momentary access to the survey camera, 
for a period such as five seconds. 

Once the Requester has located the Invitee's of- 
fice, the Requester must gain the attention of the In- 
vitee. (The reader is reminded that the Requester is 
not physically present at the Invitee's office door; the 
Requester is "virtually present." The Requester is 
physically present at a computer present in another 
office. The computer is linked to the survey camera 
located at the Invitee's office.) 

One option is to allow the Requester to instruct 
the host computer to place a small picture of the Re- 
quester onto the Invitee's computer display. The pic- 
ture beckons the Invitee's attention. This procedure is 
somewhat analagous to real life: in real life, the Re- 
quester can pop his head into the Invitee's off ice and 
announce the conference. 

The image placed onto the Invitee's screen is that 



seen by the Requester's close-up camera, and occu- 
pies a small portion of the invitee's display. The Invi- 
tee has the option of blocking such beckoning, by in- 
5 structing the host computer to block such interrup- 
tions. 

If the Invitee wishes to respond to the Requester, 
the Invitee clicks a pointing device onto the picture, 
and the host establishes video and audio connections 

10 between the two local computers. 

Another option is to allow the Requester to 
"knock" on the invitee's "door." In this case, the Re- 
quester instructs the host to cause the Invitee's com- 
puter to issue a knocking (or chiming) sound. When 

15 the Invitee responds, the host establishes the video 
and audio connection, as above. As above, the occu- 
pant can instruct the system to block all interruptions, 
including "knocking." 

The Requester tells the Invitee of the upcoming 

20 meeting. The Requester proceeds to the doors of the 
other invitees, and repeats the process. 

It is possible that the Invitee must decline the in- 
vitation to attend the conference. In such a case, the 
host should not connect the Invitee when conference 

25 time arrives. To ascertain whether the Invitee should 
be connected, the host asks the Requester which In- 
vitees should be connected. 

This inquiry can be made as the Requester 
leaves the office of each Invitee, while "walking the 

30 halls." For each Invitee who will attend, the host cre- 
ates an "invitation card" (ie, an icon) and leaves it on 
the display of the Invitee, as a reminder of the con- 
ference, as shown in Figure 3. 

The invitation card is an active icon, which pro- 

35 vides access for issuing commands to the host. For 
example, when the Invitee clicks the pointing device 
onto the icon, the local computer presents a screen 
which displays information about the conference, 
such as date, time, snd so forth, as shown in Figure 

40 3. This display is preferably a window which can be 
shrunk to a convenient size, and left on the screen by 
the Invitee to serve as a notice announcing the meet- 
ing. 

The meeting notice can be useful for a local com- 
45 puter which is located in a conference room, instead 
of an office, and which is used by several Invitees at 
once during the conference. That is, the notice con- 
stantly advertises information about the upcoming 
conference, somewhat as a "reserved" sign does for 
so a physical conference room. 

The invitation card icon provides access to other 
options, as will be explained below. 

At this time, the host knows the identities of the 
invitees. Several additional details must be resolved 
55 before the meeting begins. 

It is possible that, after an Invitee has accepted 
an invitation, something may prevent the Invitee from 
attending the forthcoming conference. That is, the In- 
vitee will be an Absentee. Ordinarily, this would create 
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a small problem: the host computer is planning to con- 
nect the Absentee's local computer with the others 
for the conference, but the Absentee will be not be 
present. If the Requester has allowed Invitees to ap- 
point Delegates to attend in their places, the Invitee 
may appoint one, in the following ways. (The menu 
used for this purpose is shown in Figure 2.) 

The Absentee can click onto the invitation card 
left on the display, and obtain access to the host com- 
puter. The host computer then presents several op- 
tions to the Absentee. The Absentee can designate a 
Delegate, and assign to the host the task of transmit- 
ting an invitation to the Delegate. 

Alternately, the Absentee himself informs the 
Delegate of the new appointment to attend the meet- 
ing in customary ways, such as by telephone. 

The Delegate can attend the meeting at several 
locations. For example, the Delegate can use the Ab- 
sentee's office. This can be preferable, because it 
does not disrupt the host computer's connection 
scheduling. 

Alternately, the Delegate can use his own office. 
In this case, the host computer must be notified, so 
that the host can connect to the Delegate's office. 
The Absentee performs the notification by clicking on 
the invitation card, which causes the host to provide 
a menu of options to the Absentee. The Absentee in- 
structs the host to substitute the Delegate for the Ab- 
sentee. 

Anotheralternate is required if the Requester has 
imposed the requirement that the meeting be confi- 
dential, or other restrictions on access, as will be ex- 
plained later. 

At the time when the Requester imposed confi- 
dentiality, the host computer asked whether Invitees 
may send Delegates. If the answer was "Yes," then 
the Requester is prompted by the host to give the Ab- 
sentee-Invitee a "key," which enables access to the 
meeting. 

For example, the key is, essentially, a block of 
data, or a code. The Requester can leave the key in 
his local computer, in the form of an icon residing on 
the display, as shown in Figure 8. Anyone entering 
the office can use the key. 

Alternately, the "key" icon is contained within a 
"vault" icon, as shown in Figure 8. Now, a user must 
use a "combination" to the "vault" to obtain the "key." 
In this latter example, the the "combination" (ie, a 
pass-code) is obtained from the Absentee-Invitee in 
some appropriate way. At conference time, the Dele- 
gate opens the "vault," obtains the "key," and enters 
the conference room, by using the key. 

This procedure is analogous to real life: the Ab- 
sentee can leave the key to the conference room on 
his desk. Or the Absentee can hide the key, or leave 
it in a locked drawer. 

If the Delegate wishes to attend the conference 
at his or her own office, the "key" can be passed to 



the Delegate via the LAN-WAN network set up by the 
host. That is, as shown in Figure 3, one of the options 
on the invitation icon is to pass the key to a Delegate. 

5 The host transfers the key, and any necessary infor- 
mation, to the Delegate. 

Several levels of confidentiality are possible. For 
example, the Requester can instruct the host to re- 
strict access solely to the Invitees' computers, and to 

10 disallow "key- passing," which would enable other 
computers to link to the conference. 

As another example, the Requester can state 
that "Spectators" can observe the conference. That 
is, any person can contact the host, obtain a list of on- 

15 going conferences, select a conference room, enter it, 
and observe the proceedings. 

As a third example, the Spectators can partici- 
pate in the meeting. In such a case, they become 
"Walk-in-lnvitees." The procedures applicable to Invi- 

20 tees apply to them. 

Once these preliminary matters are established, 
the host creates the conference room. The host does 
this by creating a common image, such as that shown 
in Figure 9. The common image includes a picture of 

25 each invitee, a "table," and the room decor. 

The pictures of the invitees can be the actual im- 
ages seen by the each invitee's close-up camera, or 
can be a photograph taken from the host's memory. 
In some situations, the photograph may be more con- 

30 venient. 

The pictures are initially grayed-out, meaning 
that they are either not presented in full contrast, or 
not in full color. Each will be given full color and con- 
trast when the respective invitee arrives at the con- 

35 ference. 

When time for the conference has arrived, the 
host computer takes roll of the participants as each 
arrives. While the early arrivals are waiting, the host 
computer provides them the options of playing 

40 games, listening to music, or seeing news or wire ser- 
vices, as indicated. 

The host can remind the arrivals of the upcoming 
meeting at various intervals, such as five minutes, 
two minutes, one minute, thirty seconds, by sending 

45 a message to their computers. 

When all participants have arrived, the meeting 
begins. 

The table is a common display area which is 
shown to, and available for work by, each Invitee. 

so That is, the image sent to each Invitee's display is a 
common image generated by the host But each Invi- 
tee can modify the image, because the host receives 
input from each Invitee, and modifies the image in re- 
sponse. Some of the modif ications are the following: 

55 Pointers. Each Invitee has a pointing device 

(or, alternately, a keyboard which can move a cursor). 
Each local computer transmits its cursor position to 
the host The host positions each Invitee's cursor on 
the table, as appropriate. With this cursor positioning, 
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each participant can point to items which he or she 
verbally discusses, using the audio link. 

Placing document on table. Each Invitee can 
transmit a file (of any suitable kind: data, text, or 5 
graphic) to the host, and the host will place the file 
onto the table, where all participants can see it. 
To place a document on the table, an Invitee performs 
a "drag-and-drop." That is, the invitee shrinks the win- 
dow of the conference room to the size shown in Fig- 1 o 
ure 1 0. The private work area outside the window dis- 
plays the icons representing the invitee's programs 
and data files. The Invitee drags an icon onto the ta- 
ble, as shown in Figure 11, and double-clicks (or ac- 
tuates) the icon. The icon blooms into an image die- is 
tated by the type of file which the icon represents 
(graphic, text, etc.) 

Modifying document Each Invitee can write 
on the document, using a "paint" - type program and 
a pointing device. Each Invitee can stretch or shrink 20 
the document, as allowed by the "Paint" program. 

Pull-down sheetsrwritlng on the walls". 
The conference table contains a "notepad." Any Invi- 
tee can pull down a note sheet, asshown in Figure 12, 
by using the pointing device, and write on the sheet. 25 
(Of course, the Invitee could write directly on the ta- 
ble, but the table may be covered with documents. 
The pull-down sheets cover whatever is on the table, 
and provide a clean writing surface. A subsequently 
pulled-down sheet would cover a previous pulled- 30 
down sheet.) 

The pull-down sheets can be enlarged at any 
time, to provide a larger writing surface, and can be 
placed at any location in the conference room, includ- 
ing the floors and walls. 35 
The pull-down sheets can be opaque or transparent. 
Further, the host can be instructed to associate each 
sheet with the document onto which it was placed, so 
that, at a later time, the sheet can be associated with 
the document, in order to see the notes which were 40 
written on the document. In this way, the participants 
can, in effect, "mark up" the documents on the table, 
without actually defacing the documents. 

The Requester is given several options of record- 
ing the conference. One option is a recording, in real- 45 
time, of all events and discussions occurring during 
the conference. This can be done by recording the se- 
quence of images occurring on the common screen, 
together with the audio information. 

Another option is to record only upon demand, so 
and to record only the demanded material (ie, either 
the common screen, or the audio, or both.) For exam- 
ple, when a given document is placed onto the table, 
the Requester can order the host computer to record 
the screen, and to record all subsequent conversa- 55 
tions, until the Requester terminates recording. In ad- 
dition, participants can order their own recordings of 
selected time intervals. One approach is for the host 
to record all proceedings in their entirety. Meanwhile, 



the host listens for recording requests form the par- 
ticipants. When a request is received, the host re- 
cords start- and finish markers, which identify the re- 
corded material requested by the participant. 

Another option is for the host to sense the place- 
ment of a document onto the table. The host then 
asks whether the screen should be recorded. The in- 
quiry can be made by a pulsing sign on the Request- 
er's screen, such as "RECORD ?" If no answer is re- 
ceived within a predetermined time, such as three 
seconds, the host does nothing. 

A third option is for the host to be equipped with 
voice recognition equipment, which can be quite ele- 
mentary. A predetermined, unusual, speech pattern, 
such as "record this now" prompts the host to record 
the screen, together with ensuing conversation, until 
the host receives a second unusual speech pattern, 
such as "stop recording now." 

The reason for using unusual speech patterns is 
that elementary speech recognition equipment can 
recognize such patterns more easily, and will not con- 
fuse common sayings with the unusual patterns. 

The Requester is given the options of whether to 
save any recorded proceedings, which to save, and 
which to erase. 

The overall operation of the described system is 
illustrated in Figs 15 to 22B. However, certain fea- 
tures are emphasized in the follwing eleven num- 
bered paragraphs. 

1. Whispering. Any participant can whisper to 
another, without being heard by others. For example, 
one party can click onto the picture of another. The 
picture becomes grayed, or otherwise different from 
the others, as shown in Figure 1 3. In addition, a prom- 
inent message is displayed on both parties' displays, 
such as "Whisper Mode is Active." 

At this time, the host makes an audio connection 
between the two whispering parties, and between 
nobody else. The parties can communicate, until they 
terminate whisper mode. 

2. Note-Passing. Parties can pass notes. One 
person can write a note, on the enlarged "NOTE" in 
Figure 13, and drag it to the picture of another party. 
When the other party sees the note on his picture, as 
in Figure 12, he can drag it to a private viewing area, 
double-click it, and read it No other people are aware 
of the passed note. 

3. Meeting Invitations and Meeting Room 
Keys. 

Before an invitation list is compiled, the level of in- 
vitations must be specified by the invitor. Three levels 
of invitations are considered. 

1. an invitation is for the Invitee only 

2. an invitation is for the Invitee, but can be 
passed to a delegate, who will attend in place of 
the Invitee. 

3. an invitation is an open invitation to anyone 
wishing to attend. 
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Invitations contain "keys" which conform to the 
above invitation level. Level 1 keys may not be passed 
to any other person and may not be copied. Level 2 
keys may be passed to exactly one other person and 
may not be copied. If the key is returned to the original 
invitee than it may be passed again. Level 3 keys may 
be freely distributed and copied. The meeting is con- 
sidered to be public. 

The meeting room "knows" about each key and its 
invitation level. Persons with improper keys are not 
admitted to the room. A person without a key may be 
admitted to the room only by someone already in the 
room or by the person responsible for the room. 

Invitations and keys are distributed electronically. 
The key is an electronic object attached to the invita- 
tion. Keys may be copied and redistributed, if permit- 
ted, or sent to another individual, if permitted. Keys 
may be E-mailed to persons or to positions (i.e. Op- 
erations Shift Manager) where the responsible indi- 
vidual will change. Confirmation of delivery and par- 
ticipation is provided. 

4. Meeting Room Creation. Meeting Facilitator 
(or Requestor) creates meeting room on a host com- 
puter which is accessible to all Invitees. The meeting 
room door is accessible from a hallway which has 
doors to other meeting rooms. Displayed on the hall- 
way walls may be various artwork which provides a 
sense of location and visual reference to persons 
"walking the hallway". Persons may associate clus- 
ters of rooms as being "physically close". On the out- 
side of each door is the room name, selected by the 
room creator. Names may reflect the nature of the 
room or simply provide an identity, such as the "Sales 
Meeting Room" or the "Einstein Room". The door may 
also indicate if the room is occupied, the number of 
occupants, their identities, whether the current meet- 
ing is open or closed and the scheduled time for the 
meeting(s). 

Room creation includes selection of location in 
hallway, color of doors and walls, equipment in room 
(i.e. table size, flip chart, file cabinet) and meeting 
tools (electronicsecretary, brainstorming module, on- 
line databases). The door lock is set to accept only t he 
appropriate keys. The door may be set to be open 
(persons in the hallway may look inside and enter 
freely-no key needed), closed (must use a key or 
knock to enter), or partially open (persons in the hall- 
way may briefly glance inside but must use a key or 
knock to enter). 

Rooms may also have doors to committee rooms 
or child-rooms. Each child-room is created in the 
same way as the parent room and may have unique 
attributes (door locks, color, tools). Achild room is de- 
pendent on the parent room for access, existence, 
etc. A person may not enter the child-room if he can- 
not enter the parent room. If the parent room is de- 
stroyed (see below) the child room will also be de- 
stroyed (unless steps are taken). 



With respect to the above description, hallways 
are actually rooms with many doors, no tools and with 
general access to all persons. Meeting rooms are 

5 child rooms of the hallway. 

5. Entering a Room. When a person wants to go 
to a room, he first enters the hallway. The user's dis- 
play shows an image of a hallway with various doors 
to rooms. The user's entry point into the hallway may 

10 set to a default location such as the end of the hallway 
or to specific locations which are frequently visited. In 
the hallway, the user may jump to a room or may stroll 
the hallway. Strolling the hallway allows a user to vis- 
ually locate himself in the hallway and to view the 

15 doors of the rooms as the user walks by. If the name 
of the room is known, the user may jump to that room 
by request. If the room or its location are not known 
or other information is desired, a user may query the 
hallway. Because rooms are children of the hallway 

20 it will respond with locations, number and names of 
occupants or other public information. Another user 
could be identified as being in a room who may then 
be "paged". 

On the doors of the rooms are signs indicating 

25 the room name, if the room is occupied, the number 
of occupants, their identities, whether the current 
meeting is open or closed and the scheduled time for 
the meeting(s). If the door is open the user may walk 
in. Akey is not required. If the door is partially opened 

30 he may peek inside for a brief moment To enter the 
user must either knock and be invited in or place his 
key on the door lock icon. If the door is closed the 
user may not peek into the room. The user may enter 
the user room using his key or by knocking on the 

35 user door and be invited inside. 

Knocking on a door alerts any participants inside 
the room to the outside user's presence. Inside the 
room, a user may query the room regarding the out- 
sider's identity or ask for an image or video of outside 

40 the door. 

To open a door with a key, the user drops the key 
onto the door lock. If the key is valid and the user has 
the authority to use the key, the door opens and the 
user is admitted to the room. The other users in the 

45 room are alerted to a new presence and receive any 
relevant information. 

When a user enters a room with no other occu- 
pants, a data connection is made between the users 
computer and the host computer which stores the 

so meeting room. The user is displayed a representation 
of the room in the condition it was last left. Documents 
may have been left on the table; drawings written on 
the walls. Because only one person is in the room, 
video and audio connections to the room are not es- 

55 tablished. If the user wishes to record and leave an 
audio or video message, audio or video connections 
may be made to the room and the message spooled 
to storage on the meeting room host. The connections 
are dropped after the message is complete. 
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When a user enters a room with other occupants, 
the data connection is made. Audio and video con- 
nections are made if supported by the user, the room 
and the other users. A small picture of each user is 
displayed in the meeting room to indicate presence. 
If video links are enabled than the picture may be re- 
placed with a video signal from the user, typically 
showing the user. The majority of the display shows 
the room's table, walls, etc. 

6. Inside the Meeting Room. Objects (docu- 
ments) can be shared in the conference room by plac- 
ing them on the table. This might be done by dragging 
an icon of the object from the outside (users non- 
"meeting room" windows) onto the table. Ownership 
of the object is still maintained. If the object owner 
wishes, the object may be copied, borrowed by other 
users, or given to other users. The object may be al- 
tered (changed, annotated) by anyone with permis- 
sion to do so. If the object is left in the room when the 
owner leaves, ownership is still retained along with 
rights and privileges. 

Public objects may be created within the room, 
such as blackboard or flip chart writings, notes or 
drawings. Paper may be pulled from a public notepad 
to indicate its "group ownership*. Anyone may write 
on to the page, enlarge it, shrink it, and post it 

Object manipulation is achieved by users individ- 
ually. Each user's pointer may be used simultaneous- 
ly for drawing, typing, pointing, writing etc, just as 
many pencils may write on a single paper simultane- 
ously. If one person removes the "paper", than no 
user has access to it. 

The room may be used to impose discipline on 
the meeting procedure. For instance, Rules of Order 
may be used to prevent a free for all of communica- 
tion. The room would require that certain procedural 
issues be followed before allowing a vote, identified 
or anonymous, to occur (another built in meeting pro- 
cedure), or before someone was allowed to speak. 
Within the room a talking queue might be built so that 
only one person would speak at a time, followed by 
the next person and so on. An "Interest Meter" might 
show the interest level of the listeners to a speaker. 
Perhaps a thermometer type of graph would show 
the interest level average of each listener voting on a 
scale of 1-10. 

7. Adjourning the Meeting. When a meeting is 
adjourned, users may leave the room and enter the 
hallway or they may exit the environment altogether. 
The data, audio and video connections are broken or 
maintained as appropriate. The room may be left in- 
tact or destroyed. If left intact then the room is avail- 
able, along with all objects stored in the room, for the 
next meeting. If destroyed, then the objects are de- 
stroyed as well if not removed. 

If the room is to remain after a meeting, then the 
objects placed on the table, in the filing cabinet or the 
writing on the wall remain as well. The security of the 



door is reset (open, closed, partially open) by the 
room owner. 

8. Destroying the Meeting Room. The room 

5 may only be destroyed by the owner. If it is to be de- 
stroyed, the room will make the owner aware of any 
objects which reside in the room which would be de- 
stroyed as well. The owner will have the opportunity 
to remove these objects from the room. 

w 9. Windows Context Much of the preceding dis- 
cussion has presumed that the local computers are 
utilizing Windows, or an equivalent. "Windows" refers 
to an operating system, or "environment" which is 
publicly available from Microsoft Corporation, One 

15 Microsoft Way, Redmond, WA 98052-6399. Develop- 
ers' packages, containing instructions and software, 
for writing programs which run in the Windows envir- 
onment, are also available from Microsoft. However, 
the invention is not limited to systems utiliziing these 

20 particular environments. 

For example, implementation of dragging-and- 
dropping, double-clicking to actuate a program, or to 
cause an icon to bloom into a screen, etc, is within the 
skill of the art. 

25 10. Persistence of Conference Room. The con- 

ference room itself is actually a combination of stored 
data and computer programs. The data can include 
the recorded proceedings of the conference descri- 
bed above. 

30 The data and the programs need not be de- 
stroyed after termination of a conference. If they are 
preserved, a person having proper authorization can 
gain entry to the conference room and examine the 
proceedings of the conference. That is, both the con- 

35 ference room and the proceedings of the conference 
have persistence in time. 

This persistence allows a person who did not at- 
tend the virtual conference in real time to witness it, 
or parts of it, afterward. 

40 11. Host Can Act as Moderator. The Requestor 
may wish to hold a conference wherein ideas are free- 
ly exchanged among the participants. It is possible 
that this intent can be defeated by an aggressive per- 
son who dominates the conference, and, in effect, 

45 maintains a "filibuster." 

The host can automatically prevent filibustering, 
in several ways. One, the host can monitor the 
speech of each person, and place a limit on the total 
time allowed to each person. The limit can be overri- 

50 den by the Requester, or by a vote taken by the host 
of the other participants. 

Two, while one participant is speaking, the host 
can monitorthe audio input of the other participants. 
The host looks for instances when the speaker refus- 

55 es to stop talking when the other participants speak. 
When the host finds such instances, the host issues 
a message to all participants stating that a filibuster 
appears to be occurring, and requests a vote as to 
whether to allow the filibuster to continue. 
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Claims 

1. A remote conferencing system, including a plur- 
ality of local computers, characterized by a host 5 
computer adapted to generate a common image 

for display by said local computers, and to allow 
users of the local computers to modify said com- 
mgji image. 

2. A remote conferencing system according to claim 
1 , characterized by audio means adapted to allow 
users of said local computers to speak with one 
another. 

15 

3. A remote conferencing system according claim 1 
or claim 2, characterized in that said local com- 
puters include video means adapted to allow 
users of said local computers to transmit video 
images to said host computer and in that said 20 
host computer is adapted to generate said com- 
mon image based on the received video images 

and to transmit said common image to said local 
computers. 

25 

4. A remote conferencing system according to claim 

3, characterized by modifying means adapted to 
allow said local computers to modify said com- 
mon image. 

30 

5. A remote conferencing system according to claim 

4, characterized in that said modifying means in- 
clude pointing devices located at said local com- 
puters and in that said common image includes 
respective pointers controlled respectively by 35 
said pointing devices. 

6. A remote conferencing system according to any 
one of the preceding claims, characterized by 
communication means adapted to permit users of 40 
two of said local computers to communicate with 
each other without the knowledge of users of 
other of said local computers. 

7. A remote conferencing system according to any 45 
one of the preceding claims, characterized in that 
said local computers include respective displays 
adapted to display a conference icon, and in that 

in response to activation of said conference icon 
by a requester, said host computer is adapted to 50 
identify selected local computers from said plur- 
ality of local computers and to establish a com- 
munications link between the identified local 
computers and the requester's computer. 

55 

8. A remote conferencing system according to claim 
7, characterized in that said requester's comput- 
er is adapted to display an image of a hallway 
containing doors bearing the names of potential 



invitees and in that said host computer is adapted 
to control the local computers of invitees to indi- 
cate invitations to a conference. 

9. A remote conferencing system according to claim 
8, characterized in that the images of said doors 
may be open, closed or ajar to indicate the status 
of potential invitees to invitations. 

10. A remote conferencing system according to any 
one of the preceding claims, characterized in that 
each local computer is associated with a close-up 
camera located in the vicinity of the local comput- 
er, and a survey camera located remotely from 
the local computer. 
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FIG. 6 

COMPANY HEADQUARTERS 
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FIG. 15A 

INITIATE CONFERENCE 



FIG. 15 



INITIATOR ACTIVATES CONFERENCE ICON | 






HOST REQUESTS: 

A) HOW MANY PA 

B) PARTICIPANT L 

C) PARTICIPANT! 

D) TIME AND DAT 


RTICIPANTS ? 
OCATION ? 
DENTIFICATION ? 
EOF CONFERENCE? 



INITIATOR ACTIVATES: 

A) HOW MANY PARTICIPANTS 



INITIATOR ENTERS A NUMBER LESS 
THAN OR EQUAL TO THE SYSTEM MAXIMUM 



INITIATOR ACTIVATES: 

B) PARTICIPANT LOCATION 



HOST PROVIDES LARGE AREA MAP~| 



INITIATOR SELECTS ZONES ( 1 - N ) 
ON LARGE AREA MAP 







HOST DISPLAYS ZONE ( 1 - N ) , SUCCESSIVELY | 
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FIG. 15B 



INITIATOR ACTIVATES SPECIFIC SITES 
( 1 - M ) IN EACH ZONE ( 1 - N ) SELECTED 



HOST STORES SPECIFIC SITE I. D. FOR SITES 
( 1 - M ) SELECTED IN EACH ZONE ( 1 - N ) 



INITIATOR ACTIVATES: 

C ) PARTICIPANT IDENTIFICATION 



HOST REQUESTS : 

1) LIST AVAILABLE? . 

2) PROVIDE SITE LISTINGS? 

3) WALK HALLS AT SITES? 




HOST REQUESTS: 



I) TYPE IN LIST? 
EE) SCAN LIST? 




HOST PROVIDES A 
LIST FOR EACH SITE 
(1-M) SELECTED 
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INITIATOR SELECTS 
PARTICIPANTS ON 
EACH SITE LIST 



FIG. 15C 




HOST PROVIDES A HALLWAY FOR EACH SITE ( 1 -"m7| 



INITIATOR SCROLLS UP / DOWN EACH 
HALLWAY ACTIVATING NAMEPLATE ON WALL 



22 



EP 0 574 138 A1 



FIG. 15D 



HOST PROVIDES EACH DOORWAY 
EITHER OPEN , CLOSED OR PARTIALLY OPEN 




INITIATOR 
REQUESTS 
PARTICIPATION 



HOST STORES LD~| 




INITIATOR 
PEEKS THROUGH 
DOORWAY 



HOST SIGNALS 
PARTICIPANT 




INITIATOR LEAVES 
MESSAGE WITH 
HOST TO REQUEST 
PARTICIPATION 

WHEN AVAILABLE 



| VOICE CONTACT ESTABLISHED' 

PARTICIPANT I. D. ACTIVATED 
BY INITIATOR IF PARTICIPANT 
WILL ATTEND CONFERENCE 



INITIATOR ACTIVATES: 

D) TIME AND DATE OF CONFERENCE 

I 



HOST REQUEST TIME AND DATE] 
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FIG.15E 

| INITIATOR TYPES IN DATE AND TIME] 



HOST ACTIVATES CONFERENCE ICON 
ON EACH PARTICIPANT'S SCREEN 
WITH FLASHING TIME AND DATE 



HOST REQUEST CONFERENCE TYPE : 

1) OPEN? 

2) RESTRICTED? 

3) SECURE? 




HOST ACTIVATES 
CONFERENCE 
ICON WITHOUT 
SPECIFIC INVITATION 
ON ALL CONNECTED 
TERMINALS 





HOST PROVIDES A 
KEY ICON FOR EACH 
PARTICIPANT AND 
SPECIFIES RULES 
FOR KEY TRANSFER 
IF PARTICIPANT WISHES 
TO SEND A SUBSTITUTE 



HOST PROVIDES A KEY ICON AND A STORAGE SAFE FOR 
THE KEY TO EACH PARTICIPANT. A CODE KNOWN ONLY TO 
THE INDIVIDUAL PARTICIPANT IS REQUIRED TO OPEN 
THE SAFE AND USE THE CONFERENCE KEY 
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CONFERENCE ROOM 



FIG. 16A 




HOST TRANSMITS 
DATA FILE TO 

TABLE OF EACH 
PARTICIPANT 



FIG. 16B 




HOST SENDS 
OPEN FILE TO ALL 
PARTICIPANT 'STABLE 



FIG. 16C 



IF 

r PARTICIPANT N 
DRAGS ICON TO 
FROM TABLE TO 
' L HIS SCREEN A ' 





ICON REMAINS ON 
TABLE AND ON SCREEN 












ACTIVATING ICON ON SCREEN PRESENTS 
DATA FILE TO INDIVIDUAL PARTICIPANT 
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ICON FOR PARTICIPANT 



FIG. 17A 




HOST TRANSMITS NOTE TO 
IDENTIFIED PARTICIPANT ONLY 
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POINTER FOR PARTICIPANT 



FIG. 18 




HOST TRANSMITS MOVE TO 
EACH PARTICIPANT'S SCREEN 



PENCIL ICON FOR WRITING 



FIG, 19 



HOST EXCLUSIVELY READS DATA 
FROM THAT PARTICIPANT ONTO TABLE 



OTHER PARTICIPANTS ARE DISABLED FROM 
THE PENCIL UNTIL THE CONTROLLING 
PARTICIPANT DEACTIVATES THE PENCIL 
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NOTEPAD ICON 

FIG. 20A 




HOST TRANSMITS DATA TO 
ALL PARTICIPANT NOTEPADS 



FIG. 20B 




HOST MOVES NOTEPAD SHEET 
AND DATA TO WALL FOR STORAGE 



NOTEPAD ICON CAN BE ACTIVATED BY ANY PARTICIPANT ; 
HOST WILL NOT ACT; 
DATA ON NOTEPAD WILL BE DISPLAYED ON INDIVIDUAL "S SCREEN 
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CONFERENCE ROOM DOORS 



FIG. 21A 




HOST ASKS IF 
PARTICIPANT WISHES 
TO WALK HALLWAY 



FIG, 21B 




HOST PROVIDES 
CONFERENCE ROOM FOR 
" DRAGGED IN " PARTICIPANTS 
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FIG. 22A 



ENDING CONFERENCE 



INITIATOR REQUESTS END CONFERENCE | 



HOST RESPONDS: 

A) MINUTES? 

B) KEEP ROOM? 



INITIATOR ACTIVATES: 
A) MINUTES 



HOST SENDS LATEST 
MODIFICATION OF 
EACH DATA FILE TO 
EACH PARTICIPANT 




HOST SENDS 
LISTING OF FILE 
MODIFICATIONS TO 
INITIATOR 









HOST 
DESTROYS 
INTERMEDIATE 
FILES 
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INITIATOR 
CHOOSES FILES 
TO KEEP 



HOST SENDS 
THOSE FILES 
INITIATOR 



HOST DESTROYS 
CONFERENCE ROOM 
ATTRIBUTES AND FILES 












HOST STORES CONFERENCE ROOM 
ATTRIBUTES AND SPECIFIED DATA FILES 













| HOST TERMINATES ACHVITES | 



FIG. 22B 
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